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Abstract. We study numerically spatio-temporal fluctuations during the out-of- 
equilibrium relaxation of the three-dimensional Edwards-Anderson model. We focus 
on two issues. (1) The evolution of a growing dynamical length scale in the glassy phase 
of the model, and the consequent collapse of the distribution of local coarse-grained 
correlations measured at different pairs of times on a single function using two scaling 
parameters, the value of the global correlation at the measuring times and the ratio of 
the coarse graining length to the dynamical length scale (in the thermodynamic limit). 
(2) The 'triangular' relation between coarse-grained local correlations at three pairs of 
times taken from the ordered instants f :J < f 2 <t±. Property (1) is consistent with the 
conjecture that the development of time-reparametrization invariance asymptotically 
is responsible for the main dynamic fluctuations in aging glassy systems as well as 
with other mechanisms proposed in the literature. Property (2), we stress, is a much 
stronger test of the relevance of the time-reparametrization invariance scenario. 



1. Introduction 

Studies of structural glasses have provided mounting evidence, both from numerical 
simulations p]-[9] and experimental probes [IQ]-[T5], that there is a growing length scale 
as a glass former is supercooled and the dynamics is heterogeneous across the system, 
with cooperative particle rearrangements occurring at the nanometer scale. More recent 
analysis in the glassy phase also suggests the existence of a growing length-scale and 
a heterogeneous character of the dynamics [16]- [25]. These findings reinforce the need 
to investigate the spatio-temporal fluctuations of glassy systems as a possible route to 
better understand the origin of the dramatic dynamical slow down in the glassy phase. 

The same two characteristics, a growing dynamical length scale and spatial 
heterogeneities, also occur in the possibly better understood spin glass problem. Indeed, 
while a precise and unambiguous connection between problems with quenched disorder 
and structural glasses is still lacking, the possibility that such connection exists has been 
put forward dating back to the work by Kirkpatrick, Thirumalai and Wolynes [261- 128) . 
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who argued for a connection between structural fragile glasses and the p-spin disordered 
model. More recently, Tarzia and Moore [29J argued that, in the presence of a uniform 
field, the Edwards-Anderson model, even in one dimension, shares many features with 
the structural glass problem, such as an apparent Kauzmann temperature and a Vogel- 
Fulcher relaxation law. Hence, understanding the spatio-temporal fluctuations in the 
Edwards-Anderson model, in addition to being interesting in itself, may help elucidate 
similar issues in structural glasses if either a connection indeed exists between these 
problems, or heterogeneous dynamics is universal in glasses even though the mechanism 
for the slow relaxation may differ in those two systems. 

In magnetic systems, aging can be globally quantified by the two-time spin- 
spin correlations, summed over all sites in the system. One of the consequences of 
heterogeneous dynamics in spin glasses is that aging, a manifestation of the breakdown 
of time translation invariance, should be non-uniform across the system. The random 
and quenched nature of the interactions naturally introduces in these different 
dynamics from site to site [3()]-[32]- In connection to the structural glass problem 
one is, though, interested in quantifying fluctuations that are not dictated by the 
random interactions but that is inherent to the glassy dynamics. Such kind of local 
dynamics and, in particular, local aging [32] can be described by the two-time spin-spin 
correlations, which instead of being spatially averaged over the whole bulk volume, are 
only averaged over a coarse-graining cell with volume V r = £ 3 centered at some site r: 



The values of such local correlations vary spatially, and can be interpreted as 
representing local and spatially heterogeneous ages of the dynamical evolution of the 
system. In this paper we focus on the statistical properties of these two-time functions. 
First, we confirm that their spatial fluctuations around the average serve to define a 
growing correlation length in the aging regime. Second, we study the fixed temperature 
probability distribution function (pdf ) p(C r ; t, t w , £, L) for a given pair of times t, t w and 
a given coarse-graining length £. L is the linear size of the system. Third, we analyse the 
triangular relations between the local coarse-grained two-time functions ([T]) measured 
at three pairs of times. Let us summarize these studies below before developing them 
in detail in the main text. 

We improve the analysis of the pdfs of local correlations presented elsewhere [3"2" | l3"3" t 
[21] by taking into account the fact that the correlation length, and the coarse-graining 
linear length, are finite in simulations and presumably also in experiments. We show 
that, indeed, the pdfs of local correlators at different pairs of times t,t w can be scaled 
onto universal curves as long as the global correlation is the same, and the ratio of the 
coarse graining length over the dynamical correlation length is held fixed. Such scaling 
can be understood as follows: at fixed temperature the pdf p(C r ;t,t w ,£, L) depends 
on four parameters, two times t, t w and two lenghts £, L. The dependence on t and 
t w can be replaced by a dependence on C(t,t w ) and £(t,t w ) with the former being the 
global correlation and the latter the correlation length evaluated at the measuring times. 




i&Vr 
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This passage is exact. The global correlation is monotonic on the two times and the 
correlation length, as we show in Sect. 14.21 is a growing function of t w and a decreasing 



scaling assumption: that the pdfs depend on the coarse graining length £, the total size 
L, and the scale £ only through the ratios £/£ and £/L. This last step, we should stress, 
is really a scaling assumption, and not a trivial requirement from dimensional analysis, 
as the lengths £, L and £ are already dimensionless as they are measured in units of 
the lattice spacing. The end result is that the pdfs characterizing the heterogeneous 
constant temperature aging of the system can be written as 



We test this proposal numerically in the 3d Edwards- Anderson (EA) spin glass assuming 
that the thermodynamic limit applies so that the last scaling ratio disappears. It is 
noteworthy that a reasonable scaling with the global correlation held fixed and ignoring 
the correlation length dependence has been already achieved, approximately, in the 
3dEA model [32], as well as in kinetically constrained models [33] and Lennard- Jones 
systems |24j . Our finding that one has to hold the ratio £/£ constant for a full collapse, 
as shown here for the 3<iEA model, should also be applied in these last two cases. In the 
random manifold problem one studied the fluctuations of the global two-time roughness 
of a finite elastic line (finite L) thus reducing the two parameters, and L/£, to the 
same one [35]. The importance of having to take into account the growing correlation 
length in the scaling analysis of the dynamics of super-cooled liquids was stressed by 
Berthier [9]. 

Next, we analyse the relation between local correlations measured at three pairs 
of times (t 3 ,t 2 ), (t 2 ,ti) and (£3,^1) on the same spatial point. We argue that the 
comparison between the local triangular relation and the global one can be used as 
a very stringent test of the time-reparametrization invariance scenario for the origin of 
dynamic fluctuations in glassy dynamics [32], [33] . 

The paper is organized as follows. In Sect. [2] we present the definition of the 3cffiA 
model. Section [3] recalls the main properties of the decay of the global correlation 
function. We discuss here several scaling forms proposed in the literature and we adopt 
the one that gives the best description of the data in the numerical time-window. We 
also recall the parametric construction relating the values of the global correlations at 
three different pairs of times that we shall use later in the local context. In Sect. H] 
we discuss the statistics of the local coarse-grained two-time correlation functions. We 
analyse the two-time dependent growing correlation length and we present its most 
convenient representation as a function of t w and the value of the global correlation. We 
study the pdf of local coarse-grained correlations and their dependence on the coarse- 
graining length i and times t and t w . We analyse the triangular relations between local 
coarse-grained correlations and we explain why the time-reparametrization invariance 
scenario makes a very concrete prediction for their behaviour. Finally, in Sect. [5] we 
present our conclusions. 



function of C thus allowing for the invertion (t, t w ) 



(C, £). The second step is a 




(2) 
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2. The model 

We focused on the three-dimensional Edwards-Anderson (3dEA) spin-glass model 
defined by the energy 

H = 2 J a SiS i ■ ( 3 ) 

The interaction strengths Jij act on nearest neighbours on a cubic 3d lattice and are 
independent identically distributed random variables taken from a Gaussian probability 
distribution with zero mean and unit variance. The spins Sj with i — 1, . . . , N — L 3 are 
bimodal Ising variables. The static critical temperature is T g ~ 0.92 [36J. 

We simulated an instantaneous quench from infinite temperature by choosing a 
random initial condition Sj(0) = ±1 with probability a half. We used Monte Carlo 
dynamics with the Metropolis algorithm to mimic the temporal relaxation of the spin- 
glass coupled to an external environment at temperature T. A Monte Carlo step (MCs) 
corresponds to iV randomly chosen spin flip attempts. 

We used lattices with linear size L = 60 and L = 100 and, in order to reduce 
finite size effects, we set periodic boundary conditions in all directions. We present 
simulations at T = 0.6; this value is optimal in the sense that it is not too close to 
the critical point and critical fluctuations should be thus reduced, and it is not too low 
so that the dynamics is not prohibitively sluggish. Similar results are obtained for a 
bimodal distribution of coupling strengths. For the time-scales reached, finite size effects 
are not important, as we checked by varying the system sizes. 

3. Global self-correlation 

The two-time self- correlation 

N 

C(t,t w ) = N- 1 Y,^(t)s l (t w ) (4) 
i=i 

measures the overlap of the spin configurations at times t w , the waiting-time, and t, the 
measuring time. It characterizes the global or macroscopic non-equilibrium relaxation 
of glassy systems. In the large N limit and for long but finite times, that is to say well 
before equilibration, the self-correlation (J4|) is self-averaging with respect to noise and 
disorder induced fluctuations [37J. By using then a few samples we reach longer time 
scales (~ 10 8 MCs) for similar system sizes than previously done in the literature. 

The two-time dependence of (T4j) is well-understood in coarsening systems [38J away 
from criticality where two two-time regimes are simply ascribed to equilibrium thermal 
fluctuations within the ordered domains and non-equilibrium domain-wall motion. In 
the limit t > t w ^> t 0) with t some microscopic time scale, the correlation can be written 
as a sum of two terms representing these two-time regimes: 

C(t, t w ) = C s t{t — t w ) + C ag (t, t w ) (5) 
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with the limit conditions 

C st (0) = 1 - q ea , \im tw ^ t - Cag(t, t w ) = q ea , 

lim^^oo C st (t - t w ) = , lim f » iro C ag (t, t w ) = . 

q ea is a measure of the equilibrium ordering. A finite limit of the equilibrium - stationary 
- part of the correlation, C st , is a sine qua non condition for the existence of a finite 
temperature phase transition. 

In ferromagnets and p spin disordered models the non-equilibrium term C ag satisfies 
dynamic scaling, 

C ag (t,t w ) ~ q ea f ( ^j^) , (6) 



R(T, t u 

with R(T, t) a monotonic function of time. The label ag indicates the aging character 
of the dynamics in the sense that older systems (longer t w 's) have a slower decay than 
younger ones (shorter t^s). Dynamic scaling ([6]) implies that any three correlations 
between three generic times to <C t 3 < t2 < t\ and taking values below the plateau at 
q ea are related by 

C ag (h, t 3 ) = q ea f {f-^Cagih, t 2 )/q ea ] f- l [C ag (t 2 , t 3 )/q ea ] } , (7) 

independently of the functional form of R(T, t). 

In the Sherrington-Kirkpatrick (SK) model [30] the aging part of the correlation 
has itself a hierarchical organisation and satisfies dynamic ultrametricity 

C ag (t u h) = min[C aff (ti, t 2 ), C ag (t 2 , t 3 )] (8) 

for generic times t\ > t 2 > t 3 ^> to such that all correlations take values below the 
plateau at q ea . The asymptotic character of this result makes it difficult to be observed 
in a numeric simulation. A preasymptotic scaling 

Cagfo^-qeaff ^V*'^ ) , With R(T e , t) ~ lnt/t . (9) 

that reaches the ultrametric relation ([S]) in the long times limit was found in the trap 
model at its critical temperature [¥T] . 

Several numerical studies of the self-correlation (JH) in the 3<iEA model appeared in 
the literature [32]- IS]- The first difficulty encountered is the identification of a plateau 
separating equilibrium and out-of-equilibrium relaxations. This separation is not as clear 
as desired in the numerical data that could as well be described with a scaling that is 
compatible with the absence of a finite temperature phase transition - a multiplicative 
scaling as found for instance in problems of elastic lines in low dimensional random 
environments [35l |3H]- However, evidence for a finite temperature phase transition in 
the 3cffiA model [3H] suggests the additive scaling Experiments on an insulating 
spin-glass sample are consistent with this type of scaling too [50J. 

The existence of a special value of C at q ea as well as the behaviour of the data 
below this value can be examined by constructing parametric plots of the correlations 
and thus testing the relations (JTj) and (JHJ). In Fig. [T]we plot C(ti,t 2 ) against C(t 2 ,t 3 ) 
at T = 0.6, using three pairs of £3, t\ (given in the caption) that yield different values of 
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C(ti,t 3 ). The construction shows a rather clear change in regime when C(ti,t 2 ) passes 
through the value ~ 0.78 and when C(t2,ts) reaches the same value. One can interpret 
the change from rather straight and flat behaviour (vertical or horizontal) to the curved 
piece in-between as a change in the two-time scaling that operates when each of the 
correlations goes beyond q ea . (Note that the vertical behaviour when t 2 gets close to ti 
is neater than the horizontal behaviour when t 2 gets close to the opposite limit £3; this is 
a finite time effect, the two-time scale separation improves at longer times.) The straight 
line pieces indicate an ultrametric relation between correlation values lying above the 
breaking point and correlation values lying below it. This is consistent with an additive 
separation between a stationary regime and an aging one. 

1 



0.8 
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U 
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C(t 2 ,t 3 ) 

Figure 1. Parametric plot of the correlation functions G{f,\,t-x) against C^jia) using 
ti as a parameter varying between £3 and t\. The curves are averaged over 5 or 7 
samples. We use t\ = 1.3 x 10 8 MCs and three values of £3 (given in the key) that 
lead to three values of C(t\,t$). As a guide-to-the-eye we show with thin solid lines 
the hyperbolic functions q ea C(ti,t^)/C{t2, £3) that fit the data correctly in the curved 
parts of the plot. 

The curved pieces (correlations taking values below the breaking points that we 
identify with q ea ) is very far from a double straight line with a square angle as expected 
for a full dynamic ultrametric behaviour. It is instead rather well described by a 
hyperbolic function with parameter q ea ~ 0.78. The data are not in the trully asymptotic 
regime and before discarding the dynamic ultrametric behaviour one should test the 
relevance of its preasymptotic form ([9]). 

In the ideal asymptotic limit of very long-waiting time and very long time- difference 
the contribution of the stationary part should saturate to zero and the full correlation 
to a constant q ea . However, the approach to the constant can be rather slow - it is a 
power in mean-field models - and thus interfere in the aging regime. One then subtracts 
the stationary contribution, assumed to be a power law, 

c st {t-t w )~A{t-t w y a (10) 
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Figure 2. Test of two two-time regimes with simple aging (a), and ultrametric scaling 
(b). The waiting-times are t w = 10 5 , 4 x 10 5 , 10 6 , 6 x 10 6 , 10 7 and t w = 5 X 10 7 
MCs. A = 10 ±2 and a = 0.5 ± 0.05 and 7 = 0.14. 



with A and a two fitting parameters [51] . A more refined analysis, including a waiting- 
time dependent correction to the stationary part estimated along the lines of the droplet 
picture, appeared in [33]. In Fig. [2] we compare the scaling form (J6]) with R ~ t 7 , 
called 'simple aging' [51] and the pre- asymptotic ultrametric scaling ([9]). The drift with 
increasing waiting-time is shown with an arrow. It is clear that, even though the collapse 
is not perfect, the simple aging form yields a much better description of the data. We 
checked that other functions, R(T, t) , such as the logarithmic growth of the droplet 
model are not as good. 

In conclusion, even though the numerical data are not utterly conclusive, they 
support the existence of a plateau at a finite q ea , with a rather slow approach of the 
stationary part to it, and an aging contribution that is best described by a simple aging 
form, R(t) ~ t 1 with 7 ~ 0.14. The values of the other parameters are q ea ~ 0.8, A = 10 
and a ~ 0.5; the function f(x) is then very close to f(x) ~ q ea /x. In short, 

ft \ ai4 

C st (t - t w ) ~ 10 (t - t w )-°- 5 , C ag ~ 0.8 ( -f j . (11) 

Note that this form is totally different from the analytic solution to the SK model [40J, 
the mean-field version of the 3cffiA model. We shall use the triangular construction in 
Sect. 14.41 to analyse dynamic fluctuations. 



4. Local fluctuations 

The local coarse-grained correlation is defined similarly to the global one [32] 

N r 

C r (t, t w ) = N- 1 Si(t) Si (t w ) (12) 

i=l 

where the sum runs over the N r = £ 3 spins lying in a cubic box with linear size I centered 
at the site r. We work with overlapping coarse- graining boxes centered on each site of 
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the lattice. In this way we improve the statistics obtaining N data points per sample. 
It is important to notice that working with Ising spins we have a natural discretization 
of the local correlations: C r varies between —1 and 1 in steps of 2/£ 3 . This effect is 
negligible when £ > 6 in such a way that 2/£ 3 < 0.01 but it is annoying for smaller 
values, e.g. £ = 3, 4. Averaging over short time-windows does not change significantly 
our results. 

The simplest way to investigate local fluctuations is to study the probability density 
function p(C r ). This function depends on five parameters: the two times t and t w , the 
coarse-graining length £, the linear size of the system L, and the temperature T that, 
in particular, determines the Edwards- Anderson order parameter q ea . In this paper we 
keep temperature fixed and henceforth ignore the temperature dependence. We use 
sufficiently large systems sizes so that in practice L — > oo. 

A more refined analysis of the fluctuations that puts the global time- 
reparametrization invariance scenario to the test consists in comparing local correlations 
measured at three pairs of times and studying the behaviour of local triangular relations. 

4-1. Evolution of the pdf with the measuring time t 

We start by analysing the evolution of p with the value of its mean, or global self- 
correlation, C, obtained using t w = 5 x 10 4 MCs and the corresponding i's (given in 
the caption) at fixed and rather small coarse-graining length, £ = 3. The curves in 
Fig. [3] (a) show that for all C values there is a peak at C r ~ 0.85 that is slightly higher 
than the value of q ea estimated from the study of the global self-correlation. The height 
of the peak diminishes with decreasing C while the weight on the tail on negative C r 's 
increases. Using such a small coarse-graining volume, many boxes partially reverse when 
times are sufficiently separated. Two undesired effects of using coarse-graining volumes 
that are too small are thus clearly identified and can be easily interpreted within a 
domain-growth picture of two competing equilibrium states. At long waiting-times a 
patchwork of domains with relatively large radii establishes. The density of domain walls 
is small. Using a small coarse-graining volume one has a high probability of contouring 
a region that remains in the 'basin of attraction of the equilibrium state' in which it 
is at time t w , with no domain- walls crossing the box - independently of how many of 
these states exist. In these cases, the local coarse-grained correlation is reduced from 
one just by thermal fluctuations and should then be very close to q ea (if the size of 
the coarse-graining box is really small one can imagine that not even all the thermal 
fluctuations needed to reach q ea enter the box and thus the peak can be at a higher 
value). When time passes, more and more of these boxes are crossed or traversed by 
domain walls and the weight of the peak diminishes while the tail of the pdf increases. 
In a simple coarsening picture with only two equilibrium states that develop relatively 
rapidly and thin domain walls between them, one should see a second peak developing 
at — q ea due to regions that have reversed, from one equilibrium state to the other, after 
the passage of a domain- wall (or an odd number of them). For the values of the global 
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Figure 3. Dependence of the pdf of local coarse-grained correlations on the value of 
the global correlation at fixed t w and varying t. The waiting time is fixed to t w = 5 x 10 4 
MCs. The total times are t = 6.5x 10 4 MCs (C = 0.78), t = 1.2 x 10 5 MCs (C = 0.7), 
t = 3 x 10 5 MCs (C = 0.6), t = 10 6 MCs (C = 0.5), t = 5.5 x 10 6 MCs (C = 0.4), and 
( = 9x 10 6 MCs (C = 0.36), and leads to the global correlation values given between 
parenthesis. Coarse- graining box with linear size I = 3 (a) and I = 6 (b). The height 
of the peak diminishes and stays located at the same C in (a) while it drifts to the left 
in (b). The left tail grows with increasing t in both cases. 

correlation (total times) reached we do not see this process here. 

The stationary character of the peak at C r ~ q ea is lost using a larger coarse- 
graining box, as shown in Fig. [3] (b). This panel also shows the evolution with t of the 
pdf of local correlations at fixed £ = 6. When t = t w the pdf is just a delta function at 
one. As t departs from t w one enters the stationary regime and the pdf is approximately 
Gaussian around its mean value C > q ea . Upon further increasing t one enters the 
interesting aging regime and the pdf departs from being Gaussian, it develops a tail 
towards small values of C r and its skewness becomes negative. At sufficiently long t the 
pdf starts symmetrizing and the fluctuations eventually become Gaussian again when 
the average C reaches zero. 

Finally, in Fig. HI we show the dependence of the pdf of local coarse-grained 
correlations on the size of the coarse-graining box measured at a fixed pair of times 
t and t w such that the global correlation is C = 0.5. The distribution evolves from a 
rather wide negatively skewed form, with the peak at C r ~ q ea and an important tail 
on negative C r 's to a Gaussian pdf centered at C upon increasing £. In the limit I = L, 
the linear size of the system, the distribution concentrates on the global value C. The 
figure shows data for I varying from 3 to 20. 

It is clear from the analysis above that one needs to use a sufficiently large coarse- 
graining box to avoid finite size and discretization effects. To study non-Gaussian 
statistics, too large coarse-graining boxes should be equally avoided. In the next Section 
we analyse the correlation length and we then give a concrete criterion to achieve the 
scaling regime. 
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Figure 4. Dependence of the pdf of local coarse-grained correlations on the size of 
the coarse-graining box for fixed total time, t, and waiting-time, t w ; t w = 5 x 10 4 MCs 
and t = 10 6 MCs in such a way that the global correlation is C — 0.5 for all data sets. 
The coarse-graining lengths are £ = 3, 5, 7, 10, 12, 15, 20 and as £ increases the pdfs 
get narrower and their maximum moves towards smaller C . 



4-2. The correlation length 

As in usual ordering processes one would like to identify a correlation length and 
determine its temperature and time- dependence. A two-time correlation length, £(t, t w ), 
apt to describe the growth of order in the low-temperature aging regime, can also be 
defined from the study of a two-site two-time correlation. In the spin language one 
defines [32] 



N 

C 4 {r;t,t w ) = N- 1 - C 2 {t, t w ) ]\ Pi - Pj \ =r (13) 

i,i=l 

and extracts £ from the fits of its decay as a function of r to an exponential. The results 
of this analysis are shown in Fig. [5] (a) where we plot £(t,t w ) as a function of t — t w 
for three values of t w given in the caption. A better representation of the same data is 
given in Fig. [5] (b) where we display £ as a function of 1 — C, evaluated at the same 
times. The curves are now monotonic in both 1 — C and t w . Finally, the t^-dependence 
can be taken into account by proposing, see Fig. [5] (c), 

5(MJ \CS(C) forC< fa , (14) 

with a ~ 0.065 and g(C) a monotonically decreasing function of C. 

We can also extract the two-time dependence of a typical length scale, to be 
associated to the correlation length, from the analysis of the functional form of the 
pdf of local coarse-grained correlations. If the pdfs of coarse-grained correlations are 
close to a Gaussian, one has summed over uncorrelated variables and the coarse-graining 
linear length has gone beyond the correlation length (at the working times t and t w ). 
On the other hand, a pdf that differs from a Gaussian should be due to correlations in 
the underlying variables (see the discussion in |33j). 
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Figure 5. Study of the two-time dependent correlation length as extracted from the 
spatial decay of C4 ion a 3dEA model with L = 100. (a) As a function of time-delay, 
(b) As a funtion of the global correlation, (c) Power law scaling with the waiting-time. 

For instance one can analyse the evolution of the skewness S = ( {C r — 
( C r )) 3 )/( (C r — (C r )) 2 ) 3 / 2 and deduce the generic trend of £ by choosing a reference 
value S* to determine the coarse-graining length at which Gaussian statistics is 
approached. In this way we obtain £,(t w ,C) with the same characteristics as the one 
shown in Fig. O 

In [32] one found £(t,t w ) ~ {tt w ) a with a a small exponent or else a logarithmic 
law of the product of the two times. We here prefer to use the more precise description 
in eq. (TH1) . Note that the maximum value of the correlation length reached is just 
a few lattice spacings, also consistent with the results found in the studies using the 
two-replica analysis [46], [47] . 

Finally, let us point out a sharp difference between our results for the dynamical 
correlation length in the glassy phase of the 3cffiA model and those found in supercooled 
liquids. In the latter, studies of the correlation between the order parameter fluctuations 
measured at different times t and t w on different regions of a single evolving sample 
found a non-monotonic behavior as a function of At = t — t w [3] [15], [62] (there 
is no waiting-time dependence there since the system is in a metastable state with 
equilibrium-like dynamics). More specifically, the integral over space of the four point 
correlation X4(At) = J d d r C^r, At) increases with Deltat until reaching a maximum 
at a temperature-dependent At* where it starts falling-off towards zero. The value of 
At* and the maximum \X = Xi{At*) increase when approaching the glass transition, 
and mode-coupling theories predict their divergence as a power law of the distance from 
criticality, T — T mct at the mode-coupling transition [57]. In our case, we work not above 
but, instead, below the glass transition temperature of the 3<iEA model, and the strictly 
increasing correlation length is accompanied by a monotonically increasing Xi{^~ tw, t w ) 
as a function of t — t w , for fixed t w . 

4-3. Time-scaling 

We are interested in characterizing p(C r ;t,t w ,£, L) in the thermodynamic limit taken 
at the outset (L — > 00), and in the asymptotic limit taken with a prescription that 
we now explain. Exploiting once again the monotonic character of the two-time global 
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correlation, the probability density becomes p(C r ;C,t w ,£) where we keep the name p 
to simplify the notation. Now, we would like to take the limit t w —>■ oo while keeping 
C fixed - to any value below the plateau q ea - but we need to specify whether we keep 
£ finite or we let it go to infinity together with t w to obtain an interesting asymptotic 
limit. The arguments in (32J1331EE] and the analysis of the numerical results discussed 
in Sect. 14.21 suggest that t w ) diverges in the limit t w — > oo and/or t — ► oo. Thus, if 
we keep I fixed while we let t w — > oo we are effectively taking smaller and smaller boxes 
with respect to the correlation length £ and thus considering regions that are artificially 
more and more correlated. This effect can be seen by plotting the pdf of local coarse- 
grained correlations at fixed C obtained by using different pairs t and t w and a fixed £: 
there is a slow drift of the weight of the pdf towards the peak at q ea . In Fig. [6] (a) we 
display the pdf of local correlations C T for several values of the pair of times t and t w 
that lead to the same global value C = 0.6. The coarse- graining length is I = 5 in all 
cases. The curves do indeed show a slow drift for increasing t w with the peak moving 
towards higher values of C r and an increasing weight of the tail on negative values. 

We are then forced to take larger and larger coarse-graining sizes as t w and t increase 
to attain a stable asymptotic limit of the probability distributions. The divergence of I 
should follow the one of £ - that is relatively slow. Considering diverging coarse-graining 
boxes one should also get rid of the C r 's that are close to and above q ea or negative. Of 
course, reaching this limit in a numerical simulation is impossible and one is forced to 
deal with finite times and finite coarse-graining size effects. 

The qualitative discussion above can be made quantitative by exploiting the 
monotonic character of £ with t and C. We can actually rewrite the pdf as a function of 
the global correlation and the correlation length, p(C r ;C, £,£)■ Using now a natural 
scaling assumption in which lengths £ and I enter only through their ratio, then 
p{C r \ C,£/£). As in standard critical phenomena universal behaviour should then appear 
in the limit: 

lim p(C r ;t,t WJ £)=p(C r ,C) . (15) 

(t,t w ,i)— >oo 
C(t,t w )=0 

The limit — ^ is impossible to impose in a numerical simulation since the values of 
the correlation length are relatively small (£ < 10). In practice, we shall then avoid 
this limit and simply work with the requirement £/£ fixed to achieve a good data 
collapse. A rough estimate of the growth of the coarse-graining length needed to scale 
the data is then given as follows. The global correlation in the aging regime scales 
as t/t w , approximately (see the analysis in Sect. [3]). In order to keep C constant one 
approximately multiplies the two times t and t w by the same constant, say v. Under 
the simultaneous dilation of times the correlation length transforms as 

Hyt, vt w ) ~ (ut w ) a g(C) = v a f (t, t w ) (16) 

where, for simplicity, we adopted the power-law behaviour [see Sect. 14.21 for the analysis 



Growing dynamical length, scaling and heterogeneities in the 3D EA model 



13 




Figure 6. Pdf of local correlations C r . (a) C r is coarse-grained on boxes of linear 
size £ = 8 at C = 0.6 fixed. The curves correspond to three waiting-times given in the 
key. There is a slow drift with increasing t w (see the text), (b) C r is coarse-grained 
on boxes with variable length £. The global correlation is the same as in panel (a), 
C = 0.6. The curves correspond to t w — 5 x 10 4 and £ = 8, t w = 2.5 x 10 5 and £ = 9, 
and t w = 10 6 and £ — 10. The collapse is improved with respect to panel (a). 

of C,(t,t w )]. We then estimate the change in coarse-graining length as 

£(ut,ut w ) ~ v a £(t,t w ) . (17) 

Given that the exponent a is very small, a ~ 0.1, the change in i is also quite small. 
For instance, if v = 2, the scaling factor is v a ~ 1.14. 

In Fig. [6] (b) we take into account the increasing correlation length with times 
t and t w and we then use a variable coarse-graining length to study the data at the 
same pairs of times. The values of I chosen follow the estimate (fTTj) - though they 
slightly differ from it - and are given in the key. With the variable coarse-graining one 
manages to locate the maxima at the same position. The collapse between the two 
longer waiting-times is now very good while the shorter waiting-time still has too much 
weight on large values of C r and a lower weight on the peak than expected. We believe 
that this is due to finite-time effects. Note also that in the ideal theoretical limit one 
should have no weight at all above q ea ~ 0.8 which is certainly not the case in the 
numerical data. The crossover between stationary and aging regimes is contaminating 
our data, especially at short waiting-times. Unfortunately, we have reached the limit of 
our numerical time-window and we cannot present results for older systems. 

The analysis of numerical data in other glassy systems should also take into 
account the growth of the correlation lenght. In particular, the approximate but not 
excellent collapse of the pdfs of local incoherent correlation functions in Lennard- Jones 
mixtures [21] should be corrected by taking into account the need to use a variable 
coarse-graining length |61j. 
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4-4- Triangular relations 

The global time-reparametrization invariance |32j suggests that in the ideal asymptotic 
limit the slow part of the coarse-grained local correlations should scale as 



with / the same function describing the global correlation [eq. flSD] in the ideal limit 
1 < £ < £ [32]. The sum rule C ag (t,t w ) = V~ l f d d r C ag (r;t,t w ) applies. We now 
present some tests of eq. ( fl8l) that are based on the parametric representation of the 
dynamics. 

In Sect. |3] we showed that two-time functions with a separation of time-scales as 
in eq. §5$) and an aging scaling as in eq. (II ip are related in a parametric way in which 
times disappear. Equation ffT8l) implies that the local (fluctuating) two-time functions 
should verify the same relation 



This is a result of the fact that time-reparametrization invariance restricts the 
fluctuations to appear only in the local functions h(r, t) while the function / is locked 
to be the global one everywhere in the sample. 

A pictorial inspection of this relation should take into account the fact that while the 
stationary decay is not expected to fluctuate, the full aging relaxation and, in particular, 
the minimal value of the local two-time functions, C(r;ti,t 3 ), are indeed fluctuating 
quantities. The parametric construction on different spatial regions should yield 'parallel 
translated' curves with respect to the global one, as displayed in Fig. [TJ Fluctuations in 
the function / would yield different functional forms in the curved part of the parametric 
construction. A more quantitative analysis can be done by using the knowledge of / that 
can be extracted from the global correlation decay. Indeed, if / is known, the parametric 
plot f~ l {C rl2 /q ea )/ \/ / _1 (C r i 3 / q ea ) against f~ l {C r2 z/ q ea )/ \/ f~ x (CV13/ Qea) should yield 
a master curve identical to the global one with different sites just being advanced or 
retarded with respect to the global value. This is another way of stating that the sample 
ages in a heterogeneous manner, with some regions being younger (other older) than 
the global average. [For simplicity we used a short-hand notation, C rfiV = C(r]tfj,,t v ) 
with /i, v = 1,2,3.] If the time-reparametrization mode is indeed flat the local values 
should lie all along this master curve in the aging regime. 

The conclusions drawn above apply in the strict 1 <C £ <C £ limit. In simulations 
and experiments £ is finite and even rather short. Thus, I is forced to also be a rather 
small parameter, in which case 'finite size' fluctuations in / are also expected to exist. 
The claim is that the latter should scale down to zero faster (in £) than the fluctuations 
that are related to the zero mode. 

We have tested these claims in the non-equilibrium dynamics of the 3c? EA spin- 
glass. The results are shown in Fig. [7J In the upper left panel we show the global 
triangular relation (thick black line) as well as the local one on four chosen sites. 





C ag {r;tx,t 3 ) = qeaf{r 1 [C a9 (r-t 1 ,t 2 )/q ea ] f^C^r, t 2 , t 3 )/ gea }} . (19) 
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Figure 7. The triangular relation in the 3dEA model with L = 100. Upper left 
panel: the thick (black) line represents the global C(t\, tz) against Cfa, £3) using t% as 
a parameter varying between f 3 = 5 x 10 4 MCs and t\ = 9 X 10 6 MCs, C(t\, £3) ~ 0.35 
and q ea ~ 0.8, c/r. Fig. [TJ With different points joined with thin lines we show 
the triangular relations between the local coarse-grained correlations on five randomly 
chosen sites on the lattice (I = 30). Upper right panel and lower left and right panels: 
2d projection of the joint probability density of C(r ; t\ , t%) ^/C(t\ , £3) /C(r; t\ , £3) 
and C(r; £2, t^)yJC{t\, £ 3 )/C(r; ii, £3) at fixed three values of the intermediate time, 
t 2 = 1.5 x 10 5 MCs, 8 x 10 5 MCs and 5 x 10 6 MCs, respectively and t = 10. The global 
C(t\,t2) against C{t2,t^) using £2 as a parameter is shown with a thick green line. 
The green points indicate the location of C(£i,£2) and C(t2j£3) for the chosen ^'s. 
Each point in the scatter plot corresponds to a site, r. The lines indicate the boundary 
surrounding 25%, 50% and 75% of the probability density. The cloud extends mostly 
along the global relation as predicted by time-reparametrization invariance. 



The separation of time-scales is clear in the plot. The local curves are quite parallel 
indeed. In the remaining panels in Fig. [7| we show the 2d projection of the joint 
probability density (using contours that encircle 25%, 50%, and 75% of the probability) 
of the site fluctuations in the local coarse-grained correlations at different chosen times 
t 2 = 1.5 x 10 5 MCs (upper right), t 2 = 8 x 10 5 MCs (lower left), and t 2 = 5 x 10 6 MCs 
(lower right). Taking advantage of the fact that f(x) ~ x _1 we use a very convenient 
normalization in which we multiply the horizontal and vertical axes by \fCi^/C r i^. 
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Global time-reparametrization invariance, expressed in eq. (1191) . implies that the data 
points should spread along the global curve indicated with a thick green line in the 
figure. Some sites could be advanced, others retarded, with respect to the global value 
- shown with a point on the green curve - but all should lie mainly on the same master 
curve. This is indeed quite well reproduced by the simulation data in the three cases, 
C(ti,t 2 ) close to C(ti,t 3 ) (upper right panel), C(ti,t 2 ) close to q ea (lower right panel), 
and C(ti,t 2 ) far from both (lower left panel). Most of the data points tend to follow 
the master curve though some fall away from it. The reason for this is that eq. ( fl9l) 
should be strictly satisfied only in the very large coarse-graining volume limit (£ ^> 1) 
with £/£ <^ 1 while we are here using £ = 10 ~ f , see the discussion in Sect. 14.21 

Finally, notice that, in contrast to the growing correlation length scale, there is 
no blatantly obvious explanation of these triangular relations within other theoretical 
scenarios. These relations are perhaps the most direct consequence of the time 
reparametrization symmetry arguments. 

4-5. Normal form of the pdfs 

Once we established that, due to the growth of the correlation length, it is necessary to 
use different coarse-graining lengths to compare the pdf of local correlations evaluated 
at different times we now go back to the raw data and we study the functional form 
of the pdfs, cfr. Fig. [3j The reason for this study is that the time-reparametrization 
invariance scenario yields precise predictions on the functional form that one would like 
to test [33J. 

To this end, we change variables and we plot ap(C r ) against {C r — C)/cr with a 
the mean-square displacement. Note that, due to the scaling hypothesis a also depends 
on C and Evidently, the transformation into the normal form is not sufficient to 
eliminate the dependence on C and £/£ from p. Keeping this fact in mind, we present 
data for ap(C r ) > 1(T 3 in Fig. El 

Several features of these curves deserve a careful description. First, the abrupt end 
of the data on the right is due to the finite values of £. Indeed, the probability is strictly 
zero for C r > 1 while it is notably different from zero for C r = 1 as soon as £ is finite 
and not too large. Second, for small values of £ the peak is located close to q ea while it 
moves to the left for increasing £. Third, it is clear that the decay on the right of the 
peak is much faster than the one on the left. Fourth, for small £ the dependence on C 
appears on the tails (left and right) and it disappears close to the peak, cfr. Fig. [31 

One can now try to find a convenient functional form to describe the numerical 
data for sufficiently large £, say of the order of £(t,t w ) ~ 5. In [33] the pdfs of the 
local connected correlations in kinetically facilitated models and the global spin-spin 
correlation (jlj) in small size 3cffiA models for values of C that are not too far from q ea 
were analysed using an extension of the Gumbel distribution of extreme value statistics: 

*.(y) = e< a ^- ca(y - yo> ) , (20) 

Via) 
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where T(a) is the gamma function. The parameters yo and a control the position of 
the center and the width of the distribution, respectively. By fixing the parameters 
a = ^JW{a) and y = [log a — iff (a)]/ a where VP (a) is the digamma function iff (a) = 
r'(a)/r(a), one ensures that the center is at zero and the width is unity. The Gumbel 
distribution with with integer parameter a > 1 describe the distribution of the a-th 
largest (smallest) value in a sequence of independent identically distributed random 
variables with a probability density decaying faster than any power law. For any a, 
there is a choice of sign for a and the two signs correspond to the Gumbel statistics of 
either extreme minima or extreme maxima. If the Gumbel is taken to its normal form 
by fixing the coefficient a, it approaches the normal form of the Gaussian for increasing 
a. 

In Fig. [8] we compare the numerical data to the functional form ( 1201) and the 
Gaussian with zero mean and unit variance. The data on each panel are for three values 
of the global correlation C ~ 0.7, C ~ 0.6 and C ~ 0.5 not too far from q ea ~ 0.8; the 
difference between panels is the length of the coarse-graining box, £ = 5 (a), £ = 10 
(b), £ — 15 (c). For small £ the complete data deviate from both functional forms. 
There is, as expected, a systematic dependence on C that is most clear on the left tail. 
An exponential decay of the tail on the left (as found in the Gumbel form) yields a 
satisfactory description of the data for each C at sufficiently small (C r — C)/a, as shown 
by the straight line. As £ increases the data get closer to ( 1201 on the whole range - 
note however that the numerical data are constrained to vary between (— 1 — C)/o~ and 
(1 — C)/a on the horizontal axis (shown with vertical arrows) while the independent 
variable in the functional form (|20|) can take any real value. In panels (b) and (c) there 
is no systematic dependence on C . The value of the parameter a has been chosen to 
yield the best description of the full set of data, finding that a increases with increasing 
£ thus approaching a Gaussian (though it has not reached it yet for I = 15). 

In summary, for finite £ one identifies three functional forms of the pdf of local 
correlations, once put in normal form: 

• £ <C £ Nothing special (since for small £ this means £ of the order of the lattice 
spacing) . 

• £ ~ £ Gumbel-like. 

• £ £ Gaussian. 

Note that in the ideal t, t w — > oo, and £ — > oo limits one should have an interesting 
scaling regime when £/£ — > 0, now with £ very large. 

Let us focus on sufficiently long coarse-graining lengths such that the Gumbel and 
then Gaussian functional forms give a reasonable description of the data with a variable 
a. The full pdf and hence the parameter a itself depend on the two times and the coarse- 
graining length £. Trading the two times by the global correlation and the correlation 
length, as explained in Sect. HI one has a(t,t w ,£) — > a(C,£,£). One again, our scaling 
hypothesis implies a(C, £/£). Quite remarkably, the pdfs once presented in normal form, 
and in particular a, do not show a strong dependence on C in the accessed range of 
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Figure 8. Normal form of the pdf of local coarse-grained correlations at t w = 5 x 10 4 
and t = 1.2 x 10 5 (C = 0.701), t = 3 x 10 5 (C = 0.601) and t = 10 6 (C = 0.503) and 
different values of the coarse-graining length £ = 5, 10, 15 as indicated in the keys. 
Comparison to different functional forms, in particular the Gumbel (solid line) and 
the Gaussian (dashed line) functions. The three arrows indicate the right-edge of the 
numerical distribution, (1 — C)/a. The values of a are the following. When the global 
correlation is C = 0.701: a = 0.180 for I = 5, a = 0.0785 for i = 10 and a = 0.0455 
for I = 15. When the global correlation is C = 0.601: a = 0.233 for £ = 5, a = 0.112 
for £ = 10 and a — 0.0675 for £ = 15. When the global correlation is C — 0.503: 
a = 0.278 for I = 5, a = 0.131 for £ = 10 and a = 0.0772 for £ = 15. Note that the 
exponential fit of the left tail gives a quite correct description for C — 0.701 and £ = 5 
but for larger values of £ the tail deviates since the pdf is approaching the Gaussian. 
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values. 

Recently, Bertin and Clusel gave a simple explanation of the ubiquity of Gumbel- 
like probability distributions of fluctuations [60j. They showed that sums of infinitely 
many correlated random variables, with special correlations, are distributed according to 
a Gumbel functional form. In the case in which the correlation arises due to a rewriting 
of the maximum of a sequence as a sum over ordered differences, one finds the ordinary 
Gumbel pdf of extreme value statistics. For other, more general correlations one finds 
that the sum is distributed according to the Gumbel functional form with a continuous 
parameter a (even other functions are possible). In our problem, the local coarse-grained 
correlations are, by construction, sums of correlated random variables. The fact that 
we find a functional form that resembles a generalized Gumbel distribution, with a 
parameter that depends on £ and the value of the global correlation, is then consistent 
with the observation of Bertin and Clusel. 

From our point of view, these results are interesting and support the conjecture 
that the development of global time-reparametrization invariance is the mechanism by 
which dynamic fluctuations generate in glassy dynamics. Indeed, the phenomenological 
effective action for local fluctuations proposed in [33J suggested by this symmetry 
captures this functional form when C ~ q ea . 

5. Conclusions 

The peculiar dynamics of glassy systems, leading to an asymptotically divergent 
correlation length, implies that highly non-trivial fluctuations will still be present at 
longer and longer length scales as times increase. Local fluctuations can be captured by 
studying coarse-grained local two-time correlations, which provide a measure of local 
aging in the system, while the global measure of aging is obtained by simply taking the 
coarse-graining length to be the bulk system size L. The presence of a growing length 
scale affects the distributions of local correlations, in that larger and larger regions in 
space become correlated, and the local average over a coarse-graining region will not be 
simply Gaussian-distributed if the coarse-graining length £ is not much larger than the 
two-time correlation length t w ). 

In this paper we studied the effect of such growing length scale on the scaling 
of the distributions of local correlations in the 3cffiA model. We found that the pdfs 
of local coarse-grained correlations p(C r ;t,t w ,£, L) can be scaled into universal curves 
that depend on the four parameters t,t w ,£,L only through three scaling variables: the 
value of the global correlation C(t, t w ), and the ratios between the length scales and the 
correlation length, £/£,(t, t w ) and t w )/L. (As we stressed in the paper, the lengths £, L 
and £ are already dimensionless as they are measured in units of the lattice spacing, and 
hence the scaling as a function of the correlation length is a scaling assumption, and does 
not follow from trivial dimensionless analysis.) The influence of a 'measuring' length, 
in this case the total length, was also stressed in the study of roughness fluctuations of 
elastic manifolds |35|. 
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Because the shape of the pdfs of local correlations depend on the correlation 
length and the coarse-graining length, one can use the form of the pdfs to extract the 
growing length scale. The values of the correlation length so obtained are comparable to 
those acquired directly from four-point correlation functions. Morever, we analysed the 
evolution of the functional form of the pdf of local correlations with the coarse-graining 
length I. By comparing to a Gumbel-like functional form we studied the dependence 
of its characterising parameter, a, with the coarse-graining volume and we linked these 
observations to recent generic results on sums of correlated random variables |60j . 

The universal scalings for the pdfs of local correlations for the 3c/EA model should 
be applicable to other glassy systems as well, if there is universality in glassy behavior 
among systems that share common features such as aging behavior and a growing 
dynamical length scale. Indeed, progress in this direction has been already made 
in [21], where the pdfs for local correlations in the glassy phase of Lennard- Jones binary 
mixtures were shown to approximately collapse when grouped by fixing the value of the 
global correlation and in [33] where kinetically constrained lattice models were analysed. 
According to our findings the collapse in structural glasses should become even sharper 
if the coarse graining box sizes are scaled so as to account for the growing dynamical 
length scale. A similar phenomena, though stationary in time and with a length-scale 
controlled by the distance from 'criticality' in temperature, are expected to appear in 
super-cooled liquids too [9]. 

The existence of a growing correlation length can be explained within the time- 
reparametrization invariance scenario [63] but it could also be associated to other 
theoretical proposals such as theories based on the mode-coupling approach or random 
first order scenario [57J and its refinement including the effect of entropic droplets [64], 
dynamical criticality controlled by a zero-temperature critical point ]65J and frustration 
limited domains [66], at least in the super-cooled liquid. We then presented an 
analysis of the local coarse-grained correlations that constitutes, to our understanding, 
a much more stringent test of the time-reparametrization invariance scenario. This 
consists in comparing the local and global triangular relations for correlations measured 
at three times. Our results are consistent with the concrete predictions of the 
time-reparametrization invariance approach. Together with the tests of the local 
fluctuation-dissipation deviations ]32j these are the most accurate tests of the time- 
reparametrization invariant theory. 
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